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BACKGROUND OF THE INVENTION 

Field of the Invention 

[0001] The present invention relates to the calibration of communication channel 
parameters in systems, including mesochronous systems, in which two (or more) 
10 components communicate via an interconnection link; and to the calibration needed to 
account for drift of conditions related to such parameters during operation of the 
communication channels. 

Description of Related Art 

15 [0002] In high-speed communication channels which are operated in a mesochronous 
manner, typically a reference clock provides frequency and phase information to the two 
components at either end of the link. A transmitter on one component and a receiver on 
another component each connect to the link. The transmitter and receiver operate in 
different clock domains, which have an arbitrary (but fixed) phase relationship to the 

20 reference clock. The phase relationship between transmitter and receiver is chosen so that 
the propagation delay seen by a signal wavefront passing from the transmitter to the 
receiver will not contribute to the timing budget when the signaling rate is determined. 
Instead, the signaling rate will be determined primarily by the drive window of the 
transmitter and the sample window of the receiver. The signaling rate will also be 

25 affected by a variety of second order effects. This system is clocked in a mesochronous 
fashion, with the components locked to specific phases relative to the reference clock, 
and with the drive-timing-point and sample-timing-point of each link fixed to the phase 
values that maximize the signaling rate. 

[0003] These fixed phase values may be determined in a number of ways. A sideband 
30 link may accompany a data link (or links), permitting phase information to be passed 
between transmitter and receiver. Alternatively, an initialization process may be invoked 
when the system is first given power, and the proper phase values determined by passing 
calibration information (pattems) across the actual link. Once the drive-timing-point and 
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sample-timing-point of each link has been fixed, the system is peraiitted to start nomial 
operations. 

[0004] However, during normal operation, system conditions will change. Ambient 
temperature, component temperature, supply voltages, and reference voltages will drift 

5 from their initial values. Clock frequencies may drift due to environmental and 

operational factors, or be intentionally caused to drift in spread spectrum clock systems, 
and the Uke. Typically, the frequency drift will be constrained to lie within a specified 
range, and many of the circuits in the components will be designed to be insensitive to 
the drift. Nonetheless, the drift will need to be considered when setting the upper 

10 signaling rate of a link. In general, a channel parameter may be calibrated as a fijnction 
of one or more changing operating conditions or programmed settings. In many cases, 
drifting parameters will be plotted in the form of a two-dimensional Schmoo plot for 
analysis. Examples of programmed settings, which might be subject of calibration, or 
which might cause drift in other channel parameters, include transmitter amplitude, 

15 transmitter drive strength, transmitter common-mode offset, receiver voltage reference, 
receiver common-mode offset, and line termination values. 

[0005] As the conditions drift or change, the optimal timing points of the transmitter 
and receiver will change. If the timing points remain at their original values, then margin 
must be added to the timing windows to ensure reliable operation. This margin will 
20 reduce the signaling rate of the link. 

[0006] It is desirable to provide techniques to compensate for the condition drift, and 
provide improvements in system and component design to permit these techniques to be 
utilized. 

25 SUMMARY OF THE INVENTION 

[0007] The present invention provides a system and method for calibrating a 
communication channel, which allows for optimizing timing windows and accounting for 
drift of properties of the channel. A communication channel includes a first component 
having a transmitter coupled to a normal data source, and at least a second component 

30 having a receiver coupled to a normal signal destination. A communication link couples 
the first and second components, and other components on the link. The present 
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invention includes a method and system that provides for execution of calibration cycles 
from time to time during normal operation of the commvmication channel. A calibration 
cycle includes de-coupling the normal data source from the transmitter and supplying a 
calibration pattem in its place. The calibration pattern is transmitted on the link using the 

5 transmitter on the first component. After transmitting the calibration pattem, the normal 
data source is re-coupled to the transmitter. The calibration pattem is received from the 
communication link using the receiver on the second component. A calibrated value of a 
parameter of the communication channel is determined in response to the received 
calibration pattem. In some embodiments of the invention, the communication chaimel is 

10 bidirectional, so that the first component includes both a transmitter and a receiver, and 
second component likewise includes both a transmitter and receiver. 
[0008] The communication channel transmits data using the transmitter on the first 
component and receives data using the receiver on the second component with a first 
parameter of the communication channel, such as one of a receive and transmit timing 

15 point for the transmissions from the first to the second component, set to an operation 
value, and receives data using the receiver on the first component and transmits data 
using the transmitter on the second component with a second parameter of the 
communication channel, such as one of a receive and transmit timing point for the 
transmissions from the second to the first component, set to an operation value. 

20 [0009] According to one embodiment of the invention, a method comprises: 

storing a value of a first edge parameter and a value of a second 
edge parameter, wherein an operation value of said parameter of the 
communication channel is a function of the first and second edge 
parameters; 

25 executing a calibration cycle; 

the calibration cycle including iteratively adjusting the value of 
the first edge parameter, transmitting a calibration pattem using the 
transmitter on the first component, receiving the calibration pattem 
using the receiver on the second component, and comparing the 

30 received calibration pattem with a stored calibration pattem, to 

determine an updated value for the first edge value; 
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the calibration cycle also including iteratively adjusting the 
value of the second edge parameter, transmitting a calibration 
pattern using the transmitter on the first component, receiving the 
calibration pattern using the receiver on the second component, and 
comparing the received calibration pattern with a stored calibration 
pattern, to determine an updated value for the second edge value; 
and 

as a result of the calibration cycle, determining a new operation 
value for the parameter based on the function of the updated values 
of the first and second edge parameters. 

[0010] Some embodiments of the mvention comprise a calibration method 

comprising: 

executing a calibration cycle including transmitting a 
calibration pattern using the transmitter on the first component and 
receiving the calibration pattem using the receiver on the second 
component with the first parameter set to a calibration value, and 
determining a calibrated value of the first parameter in response to 
the received calibration pattem; and 

prior to determining said calibrated value of said calibration 
cycle, transmitting data using the transmitter on the second 
component and receiving the data using the receiver on the furst 
component with the second parameter set to the operation value. 
[0011] Methods according to some embodiments of the invention comprise executing 
calibration cycles from time to time, the calibration cycles comprising: 

de-coupling the data source from the transmitter; 

adjusting the parameter to a calibration value; 

supplying a calibration pattem to the transmitter; 

transmitting the calibration pattem on the communication link 
using the transmitter on the first component; 

receiving the calibration pattem on the communication link 
using the receiver on the second component; 
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re-coupling the data source to the transmitter and setting the 
parameter to the operation value; and 

determining a calibrated value of the parameter of the 
communication channel in response to the received calibration 

5 pattem, wherein said re-coupling occurs prior to said determining. 

[0012] A variety of parameters of the communication channel can be calibrated 
according to the present invention. In some embodiments, the parameter being calibrated 
is a transmit timing point for the transmitter of the first component. In some 
embodiments, the parameter being calibrated is a receive timing point for the receiver of 

10 the second component. In yet other embodiments including bidirectional links, the 
parameter being calibrated is a receive timing point for the receiver of the first 
component. Also, embodiments of the present invention including bidirectional links 
provide for calibration of both receive timing points and transmit timing points for the 
receiver and transmitter respectively of the first component. 

15 [0013] In some embodiments that include bidirectional links, calibration cycles are 
executed which include a step of storing received calibration patterns on the second 
component, and retransmitting such calibration patterns back to logic on the first 
component for use in calibrating receive or transmit timing points in the first component. 
In these embodiments, the second component provides storage for holding the received 

20 calibration pattems for a time period long enough to allow the first component to 

complete transmission of a complete calibration pattem, or at least a complete segment of 
a calibration pattem. The storage can be embodied by special-purpose memory coupled 
with the receiver on the second component, or it can be provided by management of 
memory space used by the normal destination on the second component. For example, 

25 the second component comprises an integrated circuit memory device in some 

embodiments, where the memory device includes addressable memory space. The 
storage provided for use by the calibration cycles is allocated firom addressable memory 
space in the memory device in these embodiments. In yet other embodiments, where the 
second component includes latch type sense amplifiers associated with memory on the 

30 component, calibration pattems may be stored in the latch type sense amplifiers while 
decoupling the sense amplifiers from the normally addressable memory space. In yet 
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Other embodiments, in which the second component comprises an integrated circuit 
memory having addressable memory space within a memory array, a segment of the 
memory array outside of the normally addressable memory space is allocated for use by 
the calibration cycles. 

5 [0014] In yet other embodiments, utilization of memory at the second component can 
be improved by providing cache memory or temporary memory on the first component. 
In such embodiments, accesses to the memory array in the second component attempted 
during a calibration cycle are directed to a cache memory on the first component. In 
other embodiments, prior to execution of the calibration cycle, a segment of the 

10 addressable memory in the second component to be used for storage of the calibration 
pattem is copied into temporary storage on the first component for use during the 
calibration cycle. 

[0015] In systems and methods according to the present invention, parameters which 
are updated by the calibration process are applied to the communication channel so that 

15 drift in properties of the communication channel can be tracked to improve reliability and 
increase operating frequency of the channel. In various embodiments of the calibration 
process, the steps involved m calibration cycles are reordered to account for utilization 
patterns of the communication channel. For low latency processes, for example the step 
of applying the updated parameter is delayed, so that normal transmit and receive 

20 processes can be resumed as soon as the calibration pattem has been transmitted, and 
without waiting for computation of updated parameters. For example, the updated 
parameter calculated during one calibration cycle is not applied to the commimication 
channel, until a next calibration cycle is executed. In yet another example, the calibration 
cycle includes a first segment in which calibration patterns are transmitted, and a second 

25 segment in which updated parameters calculated during the calibration cycle are applied, 
so that the time interval between completion of transmission of the calibration pattem and 
completion of the calculation of the updated parameters is utilized for normal 
transmission and receive operations. 

[0016] Other aspects and advantages of the present invention can be seen on review 
30 of the drawings, the detailed description and the claims, which follow. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0017] Fig. 1 is a simplified diagram of two components interconnected by a 
communication channel. 

[0018] Fig. 2 is a timing diagram illustrating timing parameters for a communication 
5 channel like that shown in Fig. 1 . 

[0019] Fig. 3 illustrates an embodiment of the present invention where both a 

transmitter drive point and a receiver sample point are adjustable. 

[0020] Fig. 4 illustrates an embodiment of the present invention where only a 

receiver sample point is adjustable. 
10 [0021] Fig. 5 illustrates an embodiment of the present invention where only a 

transmitter drive point is adjustable. 

[0022] Fig. 6 is a flow chart illustrating calibration steps for a transmitter on a 
unidirectional link for a transmitter drive point. 

[0023] Fig. 7 illustrates timing for iteration steps for calibratmg a transmitter drive 
15 point. 

[0024] Fig. 8 is a flow chart illustrating calibration steps for a receiver on a 
unidirectional link for a sample point. 

[0025] Fig. 9 illustrates timing for iteration steps for calibrating a receiver sample 
point, 

20 [0026] Fig. 10 illustrates an embodiment of the present invention where transmitter 
drive points and receiver sample points on components of a bidirectional link are 
adjustable. 

[0027] Fig. 1 1 illustrates an embodiment of the present invention where receiver 
sample points on components of a bidirectional link are adjustable. 
25 [0028] Fig. 12 illustrates an embodiment of the present invention where both 
components have adjustable transmitter drive points. 

[0029] Fig. 13 illustrates an embodiment of the present invention where a transmitter 
drive point and a receiver sample point of only one component on a bidirectional link are 
adjustable. 

30 [0030] Fig. 14 is a flow chart illustrating calibration steps for a transmitter drive point 
for a bidirectional link. 
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[0031] Fig. 15 is a flow chart illustrating calibration steps for a receiver sample point 
for a bidirectional link. 

[0032] Figs. 16 and Fig. 17 illustrate time intervals for operation of components on a 
bidirectional link during calibration using a system like that of Fig. 13. 
5 [0033] Fig. 1 8 illustrates a first embodiment of the invention including storage for 
calibration patterns on one component. 

[0034] Fig. 19 illustrates a second embodiment of the invention including storage 
within a memory core used for storage of calibration patterns on one component sharing a 
bidirectional link. 

10 [0035] Fig. 20 illustrates a third embodiment of the invention including storage 
within a memory core for storage of calibration patterns on one component sharing a 
bidirectional link, and a cache supporting use of a region of the memory core for this 
purpose. 

[0036] Fig. 21 illustrates a fourth embodiment of the invention including storage 
15 within a memory core for storage of calibration patterns on one component sharing a 

bidirectional link, and temporary storage supporting use of the region of the memory core 
for this purpose. 

[0037] Fig. 22 illustrates a fifth embodiment of the invention including storage wdthin 
sense amplifiers, which are used for storage of calibration pattems during calibration on 
20 one component sharing a bidirectional link. 

[0038] Fig. 23 is a flow chart illustrating calibration steps for a transmitter on a 
unidirectional link for a transmitter drive point, with re-ordered steps for improved 
throughput. 

[0039] Fig. 24A and 24B are flow charts illustrating calibration steps for a transmitter 
25 drive point for a bidirectional link, with re-ordered steps for improved throughput. 

[0040] Fig. 25 illustrates an embodiment of the present invention where a transmitter 
drive point and a receiver sample point of one component on a bidirectional link are 
adjustable with a plurality of parameter sets, and wherein the bidirectional link is coupled 
to a plurality of other components corresponding to the plurality of parameter sets. 
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DETAILED DESCRIPTION 
[0041] A detailed description of embodiments of the present invention is provided 
with reference to the Figures. 

Transmitter and Receiver Timing Parameters 
5 [0042] Fig. 1 shows two components 10, 11 connected with an interconnection 

medium, referred to as Link 12. One has a transmitter circuit 13 which drives symbols 

(bits) on Link 12 in response to rising-edge timing events on the intemal CLKT signal 14. 

This series of bits forms signal DAT AT. The other has a receiver circuit 15 which 

samples symbols (bits) on Link 12 in response to rising-edge timing events on the 

10 mtemal CLKR signal 16. This series of bits forms signal DATAR. Fig. 2 illustrates the 
timing parameters, including the transmit clock CLKT signal 14 on trace 20, the 
transmitter signal DATAT on trace 21, the receive clock CLKR signal 16 on trace 22, 
and the receiver signal DATAR on trace 23. The transmitter eye 24 and the receiver eye 
25 are also illustrated. The transmitter eye 24 is a window during which the signal 

15 DATAT is transmitted on the link. The receiver eye is a sampling window defined by the 
ts setup time and Xh hold time which surround the CLKR rising edge 35,36 and define 
the region m which the value of DATAR must be stable for reliable sampling. Since the 
valid window of the DATAT signal is larger than this setup/hold sampling window 
labeled receiver eye 25, the receiver has timing margin in both directions. 

20 [0043] The DATAT and DATAR signals are related; DATAR is an attenuated, time- 
delayed copy of DATAT. The attenuation and time-delay occur as the signal wavefronts 
propagate along the interconnection medium of Link 12. 

[0044] The transmitter circuit 13 will begin driving a bit (labeled "a") no later than a 
time tQ,MAx after a rising edge 30 of CLKT, and will continue to drive it during 

25 transmitter eye 24 until at least a time tv,MiN after the next rising edge 3 1 . tq^MAx and 
tv.MiN are the primary timing parameters of the transmitter circuit 13. These two values 
are specified across the fiiU range of operating conditions and processing conditions of 
the communication channel. As a result, tq^MAx will be larger than tv,MiN, and the 
difference will represent the dead time or dead band 32 of the transmitter circuit 13. The 

30 transmitter dead band 32 (tDEAD,T)is the portion of the bit timing window (also called bit 
time or bit window) that is consumed by the transmitter circuit 13: 
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tOEADJ = tQ,MAX - tv,MIN 

[0045] The receiver circuit 1 5 will sample a bit (labeled "a") during the receiver eye 
25 no earlier than a time ts,MiN before a rising edge 35 of CLKR, and no later than a time 
tH,MiN after the rising edge 35. ts,MiN and tH,MiN are the primary timing parameters of the 
5 receiver circuit. These two values are specified across the full range of operating 
conditions and processing conditions of the circuit. The sum of ts,MiN and tH,MiN will 
represent the dead time or dead band 37, 38 of the receiver. The receiver dead band 37, 
38 (toEAD^a) is the portion of the bit timing window (also called bit time or bit window) 
that is consumed by the receiver circuit: 

10 tDEAD,R = ts,MIN + tn^MIN 

[0046] In this example, the bit timing window (receiver eye 25) is one tcvcLE minus 
the tDEADj and tDEAD,R values, each of which is about 1/3 of one tcvcLE in this example. 

Unidirectional Link Alternatives 

[0047] Fig. 3 shows two components 100 (transmit component) and 101 (receive 

15 component) connected with an interconnection medium referred to as Link 102. The link 
is assumed to carry signals in one direction only (unidirectional), so one component 100 
has a transmitter circuit 103 coupled to a data source 110 labeled "normal path," and one 
component 101 has a receiver circuit 104 coupled to a destination 111 labeled "normal 
path". There are additional circuits present to permit periodic adjustment of the drive 

20 point and sample point in between periods of normal system operation. These 
adjustments compensate for changes in the system operating conditions. 
[0048] The transmitter component includes a block 105 labeled "pattem", which can 
consist of pattem storage or pattem generation circuitry, and which is used as a source of 
transmit calibration patterns. A multiplexer block 106 labeled "mux," implemented for 

25 example using a logical layer (by which the normal data path may act as a source of 
calibration patterns and, for example, a virtual switch is implemented by time 
multiplexing normal data and calibration pattems) or physical layer switch, enables the 
transmit calibration pattem set to be driven onto the link by the transmitter circuit. The 
transmitter drive point can be adjusted by the block 107 labeled "adjust". A sideband 

30 communication chaimel 1 13 is shown coupled between the component 101 and the 
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component 100, by which the results of analysis of received calibration patterns at the 
component 101 are supplied to the adjust block 107 of the component 100. 
[0049] The receiver component 101 includes a block 108 labeled "pattem", which 
can consist of pattern storage or pattern generation circuitry, and which is used as a 
5 source of expected patterns. A block 109 labeled "compare" enables the received pattern 
set to be compared to the expected pattern set, and causes an adjustment to be made to 
either the transmitter or receiver. The receiver sample point can be adjusted by the block 
112 labeled "adjust". 

[0050] Fig. 4 shows two components 100, 101 connected with a unidirectional link 
10 102, m which components of Fig. 3 are given like reference numerals. In the 

embodiment of Fig. 4, only the receiver sample point can be adjusted; the transmitter 
drive point remains fixed during system operation. Thus, there is no adjust block 107 in 
the component 100, nor is there a need for sideband communication channel 113 of Fig. 
4. 

15 [0051] Fig- 5 shows two components 100, 101 connected with a unidirectional link 
102, in which components of Fig. 3 are given like reference numerals. In the 
embodiment of Fig. 5, only the transmitter drive point can be adjusted; the receiver 
sample point remains fixed during system operation. Thus, there is no adjust block 1 12 in 
the component 101 of Fig. 5. 

20 [0052] In general, periodic timing calibration can be performed on all three examples, 
since timing variations due to condition drift can be compensated at either the transmitter 
end or the receiver end. In practice, it is cheaper to put the adjustment circuitry at only 
one end of the link, and not at both ends, so systems of Figs. 4 or 5 would have an 
advantage. Also, it should be noted that system of Fig. 4 does not need to communicate 

25 information from the "compare" block 109 in the receiver component 101 back to the 
transmitter component 100, and thus might have implementation benefits over system of 
Fig. 5. 

Calibration Steps for Transmitter for Unidirectional Link 

[0053] Fig. 6 shows the example from Fig. 5, and also includes the steps needed to 

30 perform a timing calibration update. 

(Step 601) Suspend normal transmit and receive operations, by completing transactions in 



Page 11 of 43 



RBUS 1310-1 

■ • 

progress and preventing new ones from beginning, or by interrupting transactions that are 
in progress. 

(Step 602) Change the drive point of the transmit component from the "TX" operation 
value (used for normal operations) to either the "TXA" or "TXB" edge value (used for 

5 calibration operations) in the "adjust" block. The "TX" operation value may be a simple 
average of "TXA" and "TXB," i.e. a center value, or it may be another function of 
"TXA" and "TXB," such as a v^eighted average. It may be necessary to impose a settling 
delay at this step to allow the new drive point to become stable. 
(Step 603) Change "mux" block of the transmit component so that the "pattern" block 

10 input is enabled. 

(Step 604) A pattem set is created in the "pattern" block of the transmit component and is 

transmitted onto the "link" using the TXA or TXB drive point. 

(Step 605) The pattem set is received in the receive component. Note that the sample 

point of the receiver is fixed relative to the reference clock of the system. 
15 (Step 606) The received pattem set is compared in the "compare" block to the expected 

pattem set produced by the "pattem" block in the receive component. The two pattem 

sets will either match or not match. As a result of this comparison (and possibly other 

previous comparisons) a pass or fail determination will be made. 

(Step 607) Adjust either the "TXA" or "TXB" edge value in the transmit component as a 
20 result of the pass or fail determination. The "TX" operation value in the transmit 

component is also adjusted. This adjustment may only be made after a calibration 

sequence including transmission of two or more of calibration patterns has been 

executed, in order to ensure some level of repeatability. 

(Step 608) Change the drive point of the transmitter from the "TXA" or "TXB" edge 
25 value (used for calibration operations) to "TX" operation value (used for normal 
operations) in the "adjust" block of the transmit component. It may be necessary to 
impose a settling delay at this step to allow the new drive point to become stable. 
(Step 609) Change "mux" block of the transmit component so that the "normal path" 
input is enabled. 

30 (Step 610) Resume normal transmit and receive operations. 
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Timing for Iteration Step for Transmit 

[0054] Fig. 7 includes the timing waveforms used by the calibration steps of Fig. 6 
for a system like that of Fig. 5. These timing waveforms are similar to those from Fig. 2, 
except that the drive point is adjusted to straddle the samplmg window of the receiver in 

5 order to track the edges of the valid window of the transmitter. 

[0055] The "adjust" block in the transmit component maintains three values in 
storage: TXA, TX, and TXB. The TX value is the operation value used for normal 
operation. The TXA and TXB are the "edge" values, which track the left and right 
extremes of the bit window of the transmitter. Typically, the TX value is derived from the 

10 average of the TXA and TXB values, but other relationships are possible. The TXA and 
TXB values are maintained by the calibration operations, which from time to time, and 
periodically in some embodiments, interrupt normal operations. 
[0056] In Fig. 7, the position of the rising edge of CLKT has an offset of tpHASET 
relative to a fixed reference (typically a reference clock that is distributed to all 

15 components). 

[0057] When the TX value is selected (tpHASET(TX) in the middle trace 701 showing 
CLKT timing waveform) for operation, the rising edge 702 of CLKT causes the DATAT 
Avindow 703 containing the value "a'' to be aligned so that the DATAR signal (not shown 
but conceptually overlapping with the DATAT signal) at the receiving component is 
20 aligned with the receiver clock, successfully received, and ideally centered on the 
receiver eye. 

[0058] When the TXA value is selected (tpHASETcrxA) in the top trace 705 showing 
CLKT timing waveform), the rising edge of CLKT is set to a time that causes the right 
edges of the DATAT window 706 (containing "a") and the receiver setup/hold window 

25 710 (shaded) to coincide. The ts setup time and tn hold time surround the CLKR rising 
edge, together define the setup/hold window 710 (not to be confiised with the receiver 
eye of Fig. 2) in which the value of DATAR must be stable for reliable sampling around 
a given CLKR rising edge 704. Since the DATAT window, and the resulting DATAR 
window, are larger than this setup/hold window 710, the transmitter has timing margin. 

30 However, in the case shown on trace 705 with the transmit clock rising edge at offset 
tpHASET(TXA), all the timing margin is on the left side of the transmitter eye for the 
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setup/hold window 710, adding delay after the tq timing parameter. There is essentially 
no margin for the tv timing parameter in the trace 705, so that the offset defines the left 
edge of the calibration window. 

[0059] The calibration process for TXA will compare the received pattern set to the 
5 expected pattern set, and determine if they match. If they match (pass) then the TXA 
value will be decremented (the Tphaset(txa) offset becomes smaller shifting the transmit 
window 706 to the left in Fig. 7) or otherwise adjusted, so there is less margin for the tv 
timing parameter relative to the receiver window 710. If they do not match (fail) then the 
TXA value will be incremented (the Tphaset(txa) offset becomes larger shifting the 
10 transmit window 706 to the right in Fig. 7, or otherwise adjusted, so there is more margin 
for the tv timing parameter. 

[0060] As mentioned earlier, the results of a sequence including transmission of two 
or more calibration patterns may be accumulated before the TXA value is adjusted. This 
would improve the repeatability of the calibration process. For example, the calibration 

15 pattem could be repeated 'TM" times with the number of passes accumulated in a storage 
element. If all N passes match, then the TXA value is decremented. If any of the N 
passes does not match, then the TXA value is determined to have reached the edge of the 
window and is incremented. In another altemative, after the Nth pattem, the TXA value 
could be incremented if there are fewer than N/2 (or some other threshold number) 

20 passes, and decremented if there are N/2 or more passes. 

[0061] When TXA is updated, the TX value will also be updated. In this example, the 
TX value will updated by half the amoimt used to update TXA, since TX is the average 
of the TXA and TXB values. If TX has a different relationship to TXA and TXB, the TX 
update value will be different. Note that in some embodiments, the TX value will need 

25 slightly greater precision than the TXA and TXB values to prevent round-off error. In 
alternate embodiments, the TX value can be updated after pass/fail results of TXA and 
TXB values have been determined. In some cases, these results may cancel and produce 
no change to the optimal TX value. In other cases these resuhs may be accumulated and 
the accumulated results used to determine an appropriate adjustment of the TX setting. 

30 According to this embodiment, greater precision of the TX setting relative to the TXA 
and TXB settings may not be required. 
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[0062] When the TXB value is selected (tpHASERcrxB) in the bottom trace 707 showing 
a CLKT timing wavefomi) for calibration, the rising edge of CLKT is set to a time that 
causes the left edge of the transmitter valid window 708 (containing "a") and the receiver 
setup/hold window 710 (shaded) to coincide. In this case with the transmit clock rising 
5 edge at tpHASERgxB)? all the timing margin is on the right side of the transmit window 708, 
providing more room than required by the ty timing parameter. This means that there will 
be essentially no margin for the tg timing parameter on the left side of the window 708, 
defining the right edge of the calibration window. 

[0063] The calibration process will compare the received pattem set to the expected 

10 pattem set, and determine if they match. If they match (pass) then the TXB value vsdll be 
incremented (the offset becomes larger) or otherwise adjusted, so there is less margin for 
the tg timing parameter. If they do not match (fail) then the TXB value will be 
decremented (the offset becomes smaller) or otherwise adjusted, so there is more margin 
for the tg timing parameter. 

15 [0064] As mentioned earlier, the results of transmission of two or more calibration 
patterns may be accumulated before the TXB value is adjusted. For example, 
transmission of the pattems could be repeated '"N" times with the number of passes 
accumulated in a storage element. After the Nth sequence the TXB value could be 
decremented if there are fewer than N/2 passes and incremented if there are N/2 or more 

20 passes. This would improve the repeatability of the calibration process. 

[0065] When TXB is updated, the TX value will also be updated. In this example, the 
TX value will updated by half the amount used to update TXB, since TX is the average of 
the TXA and TXB values. If TX has a different relationship to TXA and TXB, the TX 
update value will be different. Note that the TX value will need slightly greater precision 

25 than the TXA and TXB values if it is desired to prevent round-off error. 

Calibration Steps for Receiver for Unidirectional Link 

[0066] Fig. 8 shows the example fi*om Fig. 4, and also includes the steps needed to 

perform a timing calibration update. The circuit blocks affected by each step are labeled 
with the step number. Note that only steps (Block 802), (Block 807), and (Block 808) are 
30 different relative to the steps in Fig. 6. 

(Step 801) Suspend normal transmit and receive operations, by completing transactions 
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in progress and preventing new ones from beginning, or by interrupting transactions that 
are in progress. 

(Step 802) Change the sample point of the receive component from the "RX" operation 
value (used for normal operations) to either the "RXA" or "RXB" edge value (used for 
5 calibration operations) in the "adjust" block. The "RX" operation value may be a simple 
average of "RXA" and "RXB," i.e. a center value, or it may be another function of 
"RXA" and "RXB," such as a weighted average. It may be necessary to impose a 
settling delay at this step to allow the new sample point to become stable. 
(Step 803) Change "mux" block of the transmit component so that the "pattem" block 
10 input is enabled. 

(Step 804) A pattern set is created in the "pattern" block of the transmit component and is 

transmitted onto the "link" using the TXA or TXB drive point. 

(Step 805) The pattem set is received in the receive component. Note that the transmit 

point of the transmitter is fixed relative to the reference clock of the system. 
15 (Step 806) The received pattem set is compared in the "compare" block to the expected 

pattem set produced by the "pattem" block in the receive component. The two pattem 

sets will either match or not match. As a result of this comparison (and possibly other 

previous comparisons) a pass or fail determination will be made. 

(Step 807) Adjust either the "RXA" or "RXB" edge value in the receive component as a 
20 result of the pass or fail determination. The "RX" operation value in the transmit 

component is also adjusted. This adjustment may only be made after two or more of these 

calibration sequences have been executed, in order to ensure some level of repeatability. 

(Step 808) Change the sample point of the receiver from the "RXA" or "RXB" edge 

value (used for calibration operations) to "RX" operation value (used for normal 
25 operations) in the "adjust" block of the receive component. It may be necessary to impose 

a settling delay at this step to allow the new sample point to become stable. 

(Step 809) Change "mux" block of the transmit component so that the "normal path" 

input is enabled. 

(Step 810) Resume normal transmit and receive operations. 
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Timing for Iteration Step for Receive 

[0067] Fig. 9 shows includes the timing waveforms used by the receiver calibration 
steps of Fig. 8 for a system configured for example as shown in Fig. 4. These timing 
waveforms are similar to those fi-om Fig. 2, except that the sampling point is adjusted 
5 within the bit window in order to track the edges of the window. 

[0068] The "adjust" block in the receive component maintains three values in 
storage: RXA, RX, and RXB. The RX value is the operation value used for normal 
operation. The RXA and RXB are the "edge" values, which track the left and right 
extremes of the bit window. Typically, the RX value is derived fi:om the average of the 
10 RXA and RXB values, but other relationships are possible. The RXA and RXB values 
are maintained by the calibration operations, which periodically or otherwise fi'om time 
to time interrupt normal operations. 

[0069] In the timing diagrams, the position of the rising edge of CLKR has an offset 
of tpHASER relative to a fixed reference (not shown, typically a reference clock that is 
15 distributed to all components). This offset is determined by the RXA, RX, and RXB 
values that are stored. 

[0070] When the RX value is selected (tpHASER(RX) in the middle trace 901 showing a 
CLKR timing waveform) for use in receiving data, the rising edge 902 of CLKR is 
approximately centered in the receiver eye of the DATAR signal containing the value 

20 "a". The DATAR signal is the DAT AT signal transmitted at the transmitter after 

propagation across the link, and can be conceptually considered to be the same width as 
DATAT as shown in Fig. 9. The receiver eye is shown in Fig. 2. The ts setup time is the 
minimum time before the clock CLKR rising edge which must be within the DATAR 
window 903, and the tn hold time is the minimum time after the clock CLKR rising edge 

25 that must be within the DATAR window 903, together defining the setup/hold window 
904 (not to be confiised with the receiver eye of Fig. 2) in which the value of DATAR 
must be stable for reliable sampling around a given CLKR rising edge. Since the valid 
window 904 of the DATAR signal is larger than this setup/hold window 904, the receiver 
has timing margin in both directions. 

30 [0071] When the RXA value is selected (tpHASER(RXA) in the top trace 905 showing a 
CLKR timing waveform), the rising edge of CLKR is approximately a time ts later than 
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the left edge (the earliest time) of the DATAR window 903 containing the value "a". In 
this case, the CLKR rising edge is on the left edge of the receiver eye, and all the timing 
margin is on the right side of the setup/hold window 904, providing more room than is 
required by the tH timing parameter. This means that there will be essentially no margin 
5 for the ts timing parameter, defining the left edge of the calibration window. 

[0072] The calibration process will compare the received pattern set to the expected 
pattem set, and determine if they match. If they match (pass) then the RXA value will be 
decremented (the offset becomes smaller) or otherwise adjusted, so there is less margin 
for the ts timing parameter. If they do not match (fail) then the RXA value will be 
10 incremented (the offset becomes larger) or otherwise adjusted, so there is more margin 
for the ts timing parameter. 

[0073] As mentioned earlier, the results of transmission and reception of two or more 
calibration patterns may be accumulated before the RXA value is adjusted. For example, 
the pattems could be repeated "N" times with the number of passes accumulated in a 
15 storage element. After the Nth sequence the RXA value could be incremented if there are 
fewer than N/2 passes and decremented if there are N/2 or more passes. This would 
improve the repeatability of the calibration process. 

[0074] When RXA is updated, the RX value will also be updated. In this example, 
the RX value will updated by half the amount used to update RXA, since RX is the 

20 average of the RXA and RXB values. If RX has a different relationship to RXA and 
RXB, the RX update value will be different. Note that in some embodiments, the RX 
value will need slightly greater precision than the RXA and RXB values to prevent 
round-ofif error. In altemate embodiments, the RX value can be updated after pass/fail 
results of RXA and RXB values have been determined. In some cases, these results may 

25 cancel and produce no change to the optimal RX value. In other cases these results may 
be accumulated and the accumulated results used to determine an appropriate adjustment 
of the RX setting. According to this embodiment, greater precision of the RX setting 
relative to the RXA and RXB settings may not be required. 

[0075] When the RXB value is selected (tpHASER(RXB) in the bottom trace 906 showing 
30 a CLKR timing waveform), the rising edge of CLKR is approximately a time tn earlier 
than the right edge (the latest time) of the DATAR window 903 containing the value "a". 
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In this case, the CLKR rising edge is on the right edge of the receiver eye, and all the 
timing margin is on the left side of the window 904, providing more room that required 
by the ts timing parameter. This means that there will be essentially no margin for the tH 
timing parameter, defining the right edge of the calibration window. 

5 [0076] The calibration process will compare the received pattern set to the expected 
pattern set, and determine if they match. If they match (pass) then the RXB value will be 
incremented (the offset becomes larger) or otherwise adjusted, so there is less margin for 
the tH timing parameter. If they do not match (fail) then the RXB value will be 
decremented (the offset becomes smaller) or otherwise adjusted, so there is more margin 

10 for the tH timing parameter. 

[0077] As mentioned earlier, the results of transmission and reception of two or more 
calibration pattems may be accxmiulated before the RXB value is adjusted. For example, 
the sequence could be repeated "N" times v^th the number of passes accumulated in a 
storage element. After the Nth sequence the RXB value could be decremented if there are 

15 fewer than N/2 passes and incremented if there are N/2 or more passes. This would 
improve the repeatability of the calibration process. 

[0078] When RXB is updated, the RX value will also be updated. In this example, the 
RX value will updated by half the amount used to update RXB, since RX is the average 
of the RXA and RXB values. If RX has a different relationship to RXA and RXB, the RX 
20 update value will be different. Note that the RX value will need slightly greater precision 
than the RXA and RXB values if it is desired to prevent round-off error. 

Bidirectional Link Alternatives 

[0079] Fig. 10 shows an example of a bidirectional link. In this case, component A 
(1000) and component B (1001) each contain a transmitter and receiver connected to the 

25 link, so that information may be sent either fi'om A to B or from B to A. The elements of 
the unidirectional example in Fig. 3 is replicated (two copies) to give the bidirectional 
example in Fig. 10. Fig. 10 shows two bidirectional components 1000, 1001 connected 
with an interconnection medium referred to as Link 1002. Normal path 1010 acts as a 
source of data signals for normal operation of component 1000 during transmit 

30 operations. Normal path 103 1 acts as a destination of data signals for component 1000, 
during normal receive operations. Likewise, normal path 1030 acts as a source of data 
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signals for normal operation of component 1001 during transmit operations. Normal path 
1011 acts as a destination of data signals for component 1001, during normal receive 
operations. 

[0080] The first bidirectional component includes a block 1005 labeled "pattern", 
5 which can consist of pattern storage or pattern generation circuitry, and which is used as a 
source of transmit calibration patterns. A multiplexer block 1006 labeled "mux," 
implemented for example using a logical layer or physical layer switch, enables the 
transmit calibration pattem set to be driven onto the link by the transmitter circuit 1003. 
The transmitter drive point can be adjusted by the block 1007 labeled "adjust". A 

10 sideband conmnmication channel 1013 is shown coupled between the component 1001 
and the component 1000, by which the resuhs of analysis of received calibration pattems 
at the component 1001 are supplied to the adjust block 1007 of the component 1000. 
Component 1000 also has support for calibrating receiver 1024, including a block 1028 
labeled "pattem", which can consist of pattem storage or pattem generation circuitry, and 

15 which is used as a source of expected pattems for comparison with received pattems. A 
block 1029 labeled "compare" enables the received pattem set to be compared to the 
expected pattem set, and causes an adjustment to be made to either the transmitter or 
receiver. The receiver sample point can be adjusted by the block 1032 labeled "adjust". 
[0081] The second bidirectional component 1001 includes complementary elements 

20 supporting transmitter 1023 and receiver 1004. For the receiver operations, a block 1008 
labeled "pattem", which can consist of pattem storage or pattem generation circuitry, and 
which is used as a source of expected pattems. A block 1009 labeled "compare" enables 
the received pattem set to be compared to the expected pattem set, and causes an 
adjustment to be made to either the transmitter or receiver. The receiver sample point can 

25 be adjusted by the block 1012 labeled "adjust". The second bidirectional component 
1001 supports transmission operations, with elements including a block 1025 labeled 
"pattem", which can consist of pattem storage or pattem generation circuitry, and which 
is used as a source of transmit calibration pattems. A multiplexer block 1026 labeled 
"mux," implemented for example using a logical layer or physical layer switch, enables 

30 the transmit calibration pattem set to be driven onto the link by the transmitter circuit 
1023. The transmitter drive point can be adjusted by the block 1027 labeled "adjust". A 
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sideband communication channel 1033 is shown coupled between the component 1000 
and the component 1001, by which the results of analysis of received calibration pattems 
at the component 1000 are supplied to the adjust block 1027 of the component 1001. 
[0082] The example of Fig. 10 allows both receive sample points and both transmit 
5 drive points to be adjusted. However, the benefit of adjustable timing can be realized if 
there is only one adjustable element in each direction. 

[0083] The example of Fig. 1 1 (using the same reference numerals as Fig. 10) shows 
an example in which only the receiver sample points are adjustable. Thus, elements 1007 
and 1027 of Fig. 10 are not included in this embodiment. This is equivalent to two copies 

10 of the elements of example in Fig. 4. 

[0084] The example of Fig. 12 (using the same reference nximerals as Fig. 10) shows 
an example in which only the transmitter drive points are adjustable. Thus, elements 1012 
and 1032 of Fig. 10 are not included in this embodiment. This is equivalent to two copies 
of the elements of example in Fig. 5. 

15 [0085] The example of Fig. 13 (using the same reference numerals as Fig. 10) shows 
an example in which the receiver sample point and transmitter drive point of the first 
bidirectional component 1000 are adjustable. Thus, elements 1012, 1008, 1009, 1027, 
1026, 1025 are not included in this embodiment. A storage block 1050 is added between 
the receiver and a "mux" block 1051. The "mux" block 1051 is used to select between a 

20 normal source of signals 1030 and the storage block 1050. Also, the compare block 1052 
is used for analysis of both transmit and receive calibration operations, and is coupled to 
both the adjust block 1007 for the transmitter, and adjust block 1032 for the receiver. 
This alternative is important because all the adjustment information can be kept within 
one component, eliminating the need for sideband signals for the calibration process. If 

25 component 1001 were particularly cost sensitive, this could also be a benefit, since only 
one of the components must bear the cost of the adjustment circuitry. 

Calibration Steps for Transmitter for Bidirectional Link 

[0086] The calibration steps for bidirectional examples in Figs. 10, 11 and 12 can be 

essentially identical to the calibration steps already discussed for unidirectional examples 

30 in Figs. 4 and 5. However, the asymmetry in bidirectional example of Fig. 13 will 

introduce some additional calibration steps, and will receive fiirther discussion. 
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[0087] Fig. 14 shows the example from Fig. 13, and also includes the steps needed to 
perform a timing calibration update. 

(Step 1401) Suspend normal transmit and receive operations, by completing transactions 
in progress and preventing new ones from beginning, or by interrupting transactions that 
5 are in progress. 

(Step 1402) Change the drive point of the transmit component (A) from the "TX" 
operation value (used for normal operations) to either the "TXA" or "TXB" edge value 
(used for calibration operations) in the "adjust" block. It may be necessary to impose a 
settling delay at this step to allow the new drive point to become stable. 
10 (Step 1403) Change "mux" block of the transmit component (A) so that the "pattern" 
block input is enabled. 

(Step 1404) A pattern set is created in the "pattern" block of the transmit component (A) 

and is transmitted onto the "link" using the TXA or TXB drive point. 

(Step 1405) The pattern set is received in the receive component (B). Note that the 

15 sample point of the receiver is fixed relative to the reference clock of the system. The 
received pattem set is held in the "storage" block in component B. 
(Step 1406) The "mux" block input connected to the "storage" block m component B is 
enabled. The pattem set is re-transmitted onto the link by component B. 
(Step 1407) The pattem set is received by component A from the link. 

20 (Step 1408) The received pattem set is compared in the "compare" block to the expected 
pattem set produced by the "pattem" block in the receive component (A). The two 
pattem sets will either match or not match. As a result of this comparison (and possibly 
other previous comparisons) a pass or fail determination will be made. 
(Step 1409) Adjust either the "TXA" or "TXB" edge value in the transmit component (A) 

25 as a result of the pass or fail determination. The "TX" operation value in the transmit 
component (A) is also adjusted. This adjustment may only be made after two or more of 
these calibration sequences have been executed, in order to ensure some level of 
repeatability. 

(Step 1410) Change the drive point of the transmitter from the "TXA" or "TXB" edge 
30 value (used for calibration operations) to "TX" operation value (used for normal 

operations) in the "adjust" block of the transmit component (A). It may be necessary to 
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impose a settling delay at this step to allow the new drive point to become stable. 
(Step 1411) Change "mux" block of the transmit component (A) so that the "nomial 
path" input is enabled. 

(Step 1412) Resume normal transmit and receive operations. 

5 Calibration Steps for Receiver for Bidirectional Link 

[0088] The calibration steps for bidirectional examples of Figs. 10, 1 1, and 12 can be 

essentially identical to the calibration steps already discussed for unidirectional examples 

of Figs. 4 and 5. However, the asymmetry in bidirectional example of Fig. 13 will 

introduce some additional calibration steps, and will receive further discussion. 

10 [0089] Fig. 15 shows the example from Fig. 13, and also includes the steps needed to 

perform a timing calibration update. 

(Step 1501) Suspend normal transmit and receive operations, by completing transactions 
in progress and preventing new ones from beginning, or by interrupting transactions that 
are in progress. 

15 (Step 1502) Change the sample point of the receive component (A) from the "RX" 

operation value (used for normal operations) to either the "RXA" or "RXB" edge value 
(used for calibration operations) in the "adjust" block. It may be necessary to impose a 
settling delay at this step to allow the new drive point to become stable. 
(Step 1503) Change "mux" block of the transmit component (A) so that the "pattem" 

20 block input is enabled. 

(Step 1504) A pattem set is created in the "pattem" block of the transmit component (A) 
and is transmitted onto the "link". The normal transmit drive point is used. 
(Step 1505) The pattem set is received in the receive component (B). Note that the 
sample point of the receiver is fixed relative to the reference clock of the system and is 

25 not adjustable. The received pattem set is held in the "storage" block in component B. 
(Step 1506) The "mux" block input connected to the "storage" block in component B is 
enabled. The pattem set is re-transmitted onto the link by component B. 
(Step 1507) The pattem set is received by component A from the link using either the 
RXA or RXB value to determine the receiver sample point. 

30 (Step 1508) The received pattem set is compared in the "compare" block to the expected 
pattem set produced by the "pattem" block in the receive component (A). The two 
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pattern sets will either match or not match. As a result of this comparison (and possibly 
other previous comparisons) a pass or fail determination will be made. 
(Step 1509) Adjust either the "RXA" or "RXB" edge value m the receive component (A) 
as a result of the pass or fail determination. The "RX" operation value in the receive 
5 component (A) is also adjusted. This adjustment may only be made after two or more of 
these calibration sequences have been executed, in order to ensure some level of 
repeatability. 

(Step 1510) Change the sample point of the receiver from the "RXA" or "RXB" edge 
value (used for calibration operations) to "RX" operation value (used for normal 
10 operations) in the "adjust" block of the receive component (A). It may be necessary to 
impose a settling delay at this step to allow the new sample point to become stable. 
(Step 1511) Change "mux" block of the transmit component (A) so that the "normal 
path" input is enabled. 

(Step 1512) Resume normal transmit and receive operations. 

15 Bidirectional Link - Storage Options 

[0090] The bidirectional example in Fig. 13 utilizes a storage block 1050 as part of 

the calibration process. There are a number of altemative options for implementing this 

storage, each option with its own costs and benefits. 

[0091] Fig. 13 shows an option in which the storage block is implemented as part of 
20 the interface containing the transmit and receive circuits. This has the benefit that the 
circuitry used for normal operations (the "normal path") is not significantly impacted. 
The cost of this option is that the storage block will increase the size of the interface, and 
will thus increase the manufacturing cost of the component 1001 . 
[0092] Figs. 16 and Fig. 17 show why a storage block is needed for the 
25 implementations of example of Fig. 13. The storage allows the received pattern set in 
component 1001 to be held (and delayed) prior to being re-transmitted. Fig. 16 shows a 
gap 1600 between the interval 1601 in which the pattern set is being transmitted by A 
(and received by B) and the interval 1602 in which the pattern set being transmitted by B 
(and received by A). If no storage was present, there would be a relatively small delay 
30 between the start of each these two intervals resulting in an overlap of the intervals, as 
shown in Fig. 17. In general, components on a bidirectional link are not allowed to 
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transmit simultaneously, so some storage will be required with the configuration of Fig. 
13 to prevent this. 

[0093] It is possible to design the transmitter circuits and the link so that transmitters 
on both ends are enabled simultaneously. This is called simultaneous bidirectional 

5 signaling. In such a communication system, the storage block of configuration of Fig. 13 
could be left out of component 1001. Typically, simultaneous bidirectional signaling 
requires additional signal levels to be supported. For example, if each of two transmitters 
can be signaling a bit, there are four possible combinations of two transmitters 
simultaneously driving one bit each. The four combinations are {0/0, 0/1, 1/0, 1/1}. 

10 Typically the 0/1 and 1/0 combinations will produce the same composite signal on the 
link. This requires that the transmitter circuits be additive, so that three signal levels are 
produced {0, 1, 2}. The receiver circuits will need to discriminate between these three 
signal levels. A final requirement of simultaneous bidirectional signaling is that a 
component must subtract the value it is currently transmitting from the composite signal 

15 that it is currently receiving in order to detect the actual signal from the other component. 
When these requirements are in place, the storage block requirement can be dropped. 
This is one of the benefits of this approach. The cost of this approach is the extra design 
complexity and reduced voltage margins of simultaneous bidirectional signaling. 
[0094] Fig. 1 8 shows option B in which the storage block is implemented from the 

20 storage elements 1 801 , 1 802 that are normally present in the transmit and receive circuits. 
These storage elements are typically present for pipelining (delaying) the information 
flowing on the normal paths. Storage elements may also be present to perform 
serialization and deserialization. This would be required if the intemal and external signal 
groups have different widths. For example, the extemal link could consist of a single 

25 differential wire pair carrying information at the rate or 3200 Mb/s, and could connect to 
a set of eight single-ended intemal wires carrying information at the rate of 400Mb/s. The 
information flow is balanced (no information is lost), but storage is still required to 
perform serial-to-parallel or parallel-to-serial conversion between the two sets of signals. 
This storage will create delay, which can be used to offset the two pattem sets in the 

30 option of Fig. 1 8. The benefit of this approach is that no extra storage must be added to 
component 1001. The cost is that the wiring necessary to connect the receiver to a "mux" 
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block in the transmitter may be significant. Another cost is that the amount of storage 
naturally present in the receiver and transmitter may be relatively small, limiting the 
length of the pattern set which can be received and retransmitted with this approach. 
[0095] Fig. 19 shows an option in which the storage block is implemented from the 

5 storage cells that are normally present in a memory core 1900. In this option, component 
1001 is assumed to be a memory component. In this case, the storage area 1901, labeled 
"region", is reserved for receiving the pattem set from component 1000, and for 
retransmitting the pattem set back to component 1000. This storage area may only be 
used by the calibration process, and should not be used by any normal application 

10 process. If this storage area were used by an application process, it is possible that 

application information could be overwritten by the pattem set information and thereby 
lost. The benefit of this approach is that no additional storage needs to be added to 
component 1001 (and no special path from receiver to transmitter). The cost of this 
approach is that a hole is created in the address space of the memory component. Since 

15 most memory components contain a power-of-two number of storage cells, this may 
create a problem with some application processes, particularly if two or more memory 
components must create a contiguous memory address space (i.e. with no holes). 
[0096] Fig. 20 shows an option in which the storage block is again implemented from 
the storage cells that are normally present in a memory core 1900. In this option, 

20 component B is assumed to be a memory component. In this case, the storage area 1901 
labeled "region" is reserved for receiving the pattem set from component 1000, and for 
retransmitting the pattem set back to component 1000. This storage area may only be 
used by the calibration process, and should not be used by any normal application 
process. Unlike the option in Fig. 19, however, component 1000 adds a storage block 

25 2001, labeled "cache", which emulates the storage capability of the storage area 1901 

"region". When a write is performed to the "region" of storage area 1901, it is intercepted 
and redirected to the "cache" in storage 2001. Likewise, when a read is performed to the 
"region" of storage area 1901, the read is intercepted and redirected, returning read data 
from "cache" via mux 2002. In this way, the application processes see no hole in the 

30 memory address space. The benefit of this option is that no additional storage needs to be 
added to component 1001 (and no special path from receiver to transmitter). The cost of 
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this approach is that a storage block 2001 "cache," with address comparison logic to 
determine when the application is attempting to access the region 1901, must be added to 
component 1000, as well as the control logic and "mux" block 2002 needed to intercept 
read and write commands for component 1001. 

5 [0097] Fig. 21 shows an option in which the storage block is again implemented from 
the storage cells that are normally present in a memory core 1900. In this option, 
component 1001 is assumed to be a memory component. In this case, the storage area 
1901 labeled "region" is used for receiving the pattem set from component 1000, and for 
retransmitting the pattem set back to component 1000. This storage area 1901 may be 

10 used by both the calibration process and by the application processes, however. In order 
to ensure that the application processes are not affected by the periodic calibration 
process, a temporary storage block 2101, labeled "temp", is provided in component 1000, 
along with a "mux" block 2102 for accessing it. When a calibration process starts, the 
contents of "region" are read and loaded into "temp" storage block 2101. The calibration 

15 process steps may now be carried out using the storage area 1901. When the calibration 
sequence has completed, the contents of *temp" storage block 2101 are accessed and 
written back to the "region" of storage area 1901, and the application process allowed to 
restart. Again, the application processes see no hole in the memory address space. The 
benefit of this option is that no additional storage needs to be added to component 1001 

20 (and no special path from receiver to transmitter). The cost of this approach is that a 
storage block 2101 and the "mux" block 2102 must be added to component 1000. The 
calibration process becomes longer, since a read operation must be added to the 
beginning, and a write operation must be added to the end, supporting the use of the 
'Hemp" storage block 2101. 

25 [0098] Fig. 22 shows an option in which the storage block is implemented from the 
latching sense ampUfier circuit 2201 that is present in a memory component 1001. 
Latching sense amplifier circuit 2201 includes latches or other storage resources 
associated with sense amplifiers. Most memory components use such a latching sense 
amplifier circuit 2201 to access and hold a row 2202 of storage cells from the memory 

30 core 1900. Read operations are then directed to the sense amplifier which temporarily 
holds the contents of the row of storage cells. Write operations are directed to both the 
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sense amplifier and to the row of storage cells so that the information held by these two 
storage structures is consistent. When another row of storage cells is to be accessed, the 
sense amplifier is precharged and reloaded with this different row. 
[0099] When component 1001 is a memory component with such a latching sense 

5 amplifier circuit 2201 , it is possible to modify its operation to permit a special mode of 
access for calibration. In this special mode, the sense amplifier may be written by the 
receiver circuit 1004 and may read to the transmitter circuit 1023 without first being 
loaded fi-om a row 2202 of storage cells in the memory core 1900. This permits the 
storage resource of the sense amplifier circuits 2201 to be used to store received 

10 calibration patterns, or portions of received calibration patterns, in region 2203 (which 
may include less than an entire row in some embodiments) for calibration without 
affecting the contents of the memory core, which would affect the interrupted application 
process. This second access mode would require a gating circuit 2204 between the 
memory core and the sense amplifier, which could be disabled during the calibration 

15 process. There is typically such a gating circuit 2204 in most memory components. 
[00100] A benefit of this option is that no additional storage needs to be added to 
component 1001 (and no special path from receiver to transmitter). The cost of this 
approach is that a modification must be made to critical circuits in the core of a memory 
component. 

20 Reordering of Calibration Steps to Improve Throughput 

[0100] The individual steps that are shown in the calibration processes described 

above do not necessarily have to be done in the order shown. In fact, if some reordering 

is done, the overhead of the calibration process can be reduced, improving the effective 

signaling bandwidth of the system and reducing the worst case delay seen by latency- 

25 sensitive operations. 

[0101] For example, in the case of the calibration process for the transmitter shown in 

Fig. 6, it is not necessary to perform the evaluation steps and the update steps (compare 

606 and adjust 607) in sequence as shown. Instead, the transmitter calibration process 

may be performed in the following manner: 
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(Step 2301) Suspend normal transmit and receive operations, by completing transactions 
in progress and preventing new ones from beginning, or by interrupting transactions that 
are in progress. 

(Step 2302) Control the "adjust" logic so the transmitter uses a calibrate (TXA/TXB) 
5 drive-timing-point according to the stored results of the previous comparison.. 
(Step 2303) Control the "adjust" logic so that the pattem block is coupled to the 
transmitter. 

(Step 2304) A pattem sequence is read or created from the pattem block and is 
transmitted onto the interconnect using the selected calibrate drive-timing-point. 
10 (Step 2305) The pattem sequence is received using the normal (RX) sample-timing-point. 
(Step 2306) Control the "adjust" logic so the transmitter uses a normal (TX) drive- 
timing-point. 

(Step 2307) Control the "adjust" logic so that the "normal path" to the transmitter is 
enabled. 

15 (Step 2308) Resume normal transmit and receive operations. 

(Step 2309) The received pattem sequence is compared to the expected pattem sequence 
from the "pattem" block. 

(Step 2310) The calibrate drive-timing-point (TXA/TXB, TX) is adjusted according to 
the results of the comparison. 
20 [0102] In the modified sequence, normal transmit and receive operations may be 
restarted earlier. This is possible because the comparison results are saved and used to 
adjust the timing point during the next calibration process. 

[0103] A more significant saving in overhead is possible in the system of Fig. 13, by 
changing the order of steps in the process of Fig. 14, for example. It is possible to 
25 separate the evaluation and update steps as previously described. However, it is also 
possible to perform receive operations with the first component while its transmitter is 
changing the drive-timing-point between the normal and calibrate values. The periodic 
calibration process could become: 

(Step 2401a) Suspend normal transmit operations, by completing transactions in progress 
30 and preventing new ones from beginning, or by interrupting transactions that are in 
progress 
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(Step 2402a) Control the "adjust" logic so the transmitter uses a calibrate (TXA/TXB) 
drive-timing-point according to the stored results of the previous comparison. 
(Step 2403a) Control the "adjust" logic that the pattern block is coupled to the 
transmitter. 

5 (Step 2404a) A pattern sequence is created from the "pattem" block and is transmitted 
onto the interconnect using the selected calibrate drive-timing-point. 
(Step 2405a) The pattern sequence is received in the second component and placed in 
storage. 

(Step 2406a) Control the "adjust" logic so the transmitter uses a normal (TX) drive- 
10 timing-point. 

(Step 2407a) Control the "adjust" logic so that the "normal path" to the transmitter is 
enabled. 

(Step 2408a) Resume normal transmit operations. 

[0104] Note that receive operations could continue during this process except when 
15 the calibration pattem is actually being transmitted on the interconnect. In particular, the 
component could receive while its transmitter is changing the drive-timing-point between 
the normal and calibrate values. The second set of steps for the calibration process would 

consist of: 

(Step 2401b) The pattem sequence in storage is transmitted onto the interconnect by the 
20 second component. 

(Step 2402b) The pattem sequence is received using the normal (RX) sample-timing- 
point. 

(Step 2403b) The received pattem sequence is compared to the expected pattem sequence 

from the "pattem" block. 
25 (Step 2404b) The calibrate drive-timing-point (TXA/TXB, TX) is adjusted according to 
the results of the comparison. 

[0105] Note that normal transmit and receive operations could continue during this 
process except when the calibration pattem is actually being received from the 
interconnect. 
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[0106] If reordering and overlapping of calibration steps is done, the overhead of the 
calibration process can be reduced, improvmg the effective signaling bandwidth of the 
system and reducing the worst case delay seen by latency-sensitive operations. 
[00101] The reduction in overhead can also permit the periodic calibration process to 
5 be executed at a more frequent rate. The benefit is that this will compensate for sources 
of timing drift that change more rapidly. This will permit more of the bit time to be used 
for the transmitter drive time variation and the receiver sampling window, and less of the 
bit time will be needed for timing drift within the system. 

[00102] Fig. 25 illustrates an example like that of Fig. 13, with the exception that the 
10 point to point bidirectional link of Fig. 13 is replaced with a multidrop link, coupling 
component 2500 to a plurality of components 2551, 2552. The multidrop link 
configuration can be applied in other configurations. In the representative example 
shown in Fig. 25, a first bidirectional component 2500 and a plurality of other 
bidirectional components 2551, 2552 are connected in a point to multi-point 
15 configuration, or multipoint to mxxltipoint configuration, with an interconnection medium 
referred to as Link 2502. Normal path 25 1 0 acts as a source of data signals for normal 
operation of component 2500 during transmit operations. Normal path 2531 acts as a 
destination of data signals for component 2500, during normal receive operations. The 
calibration operations are interleaved, and re-ordered, in this embodiment with normal 
20 communications, as described above to improve throughput and utilization of the 
communication medium 

[00103] The furst bidirectional component 2500 includes a block 2505 labeled 
"pattem", which can consist of pattern storage or pattem generation circuitry, and which 
is used as a source of transmit calibration patterns. A multiplexer block 2506 labeled 

25 "mux," implemented for example using a logical layer or physical layer switch, enables 
the transmit calibration pattem set to be driven onto the link by the transmitter circuit 
2503. The transmitter drive point can be adjusted by the block 2507 labeled "adjust". In 
this embodiment, the adjust block 2507 includes storage for muhiple parameter sets 
which are applied depending on the one of the other components 255 1 , 2552, ... on the 

30 link to which the transmission is being sent. Component 2500 also has support for 

calibrating receiver 2524, including a block 2528 labeled "pattem", which can consist of 
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pattern storage or pattern generation circuitry, and which is used as a source of expected 
patterns for comparison with received patterns. A block 2529 labeled "compare" enables 
the received pattem set to be compared to the expected pattern set, and causes an 
adjustment to be made to either the transmitter or receiver. The receiver sample point can 

5 be adjusted by the block 2532 labeled "adjust". In this embodiment, the adjust block 
2507 includes storage for multiple parameter sets which are applied depending on the one 
of the other components 25 5 1 , 25 52, ... on the link from which the communication is 
being received. In the first component 2500, the compare block 2529 is used for analysis 
of both transmit and receive calibration operations, and is coupled to both the adjust 

10 block 2507 for the transmitter, and adjust block 2532 for the receiver. In the example of 
Fig. 25, the receiver sample point and transmitter drive point of the first bidirectional 
component 2500 are adjustable. The other components 2551, 2552, ... are implemented 
as described with reference to Fig. 13 without adjustment resources, in this example, and 
not described here. In alternative embodiments, the components 2551, 2552, ... on the 

15 Imk may be provided with adjustment and calibration resources, as described for other 
embodiments above. 

[0107] While the present invention is disclosed by reference to the preferred 
embodiments and examples detailed above, it is to be understood that these examples are 
intended in an illustrative rather than in a limiting sense. It is contemplated that 
20 modifications and combinations will readily occur to those skilled in the art, which 

modifications and combinations will be within the spirit of the invention and the scope of 
the foUowmg claims. What is claimed is: 
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